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LIST BUILDING SYSTEM 

Field of the Invention ; 

The invention pertains to software driven systems and methods for 
5 developing audio/video sequences. More particularly, the invention pertains to such 

system and methods wherein a user can create an editable list of works which can be 
presented. 

Background of the Invention : 

With the advent of CDs a wide variety of music, music videos or video 

10 sequences are conveniently available for a user in a non-analog, digital format. The 

advantages of digital recording of both audio and video have been recognized and are 
to a great extent realized with the ready availability of pre-recorded CDs. 

While convenient, pre-recorded CDs present a problem to a user in that 
while it is possible to select sequentially between the pre-recorded works on a given 

1 5 CD, to switch to another artist or group it is necessary to have multiple drives available 

or to remove one CD and insert another at the appropriate time. While possible, such 
arrangements are at the very least inconvenient. In addition, because of the delays 
inherent in switching from one CD to another, the audio or video output might be lost 
for an undesirably long period of time thereby detracting from the ambiance afforded 

20 by the performance. In addition, listeners at times are only interested in one or two of 

the tracks on a CD in a given situation. 

There thus continues to be a need for systems and methods which will 
make it possible to combine works by a variety of performers or artists in a relatively 
arbitrary fashion and to present those works in a given sequence in a fashion that is 

25 convenient but which at the same time is cost effective. It would also be desirable to 

be able to use widely available personal computers as control elements in such 
systems. 

Summary of the Invention : 

A system and a method of arranging media elements for later replay 
30 make it possible to create new sequential presentations of the elements. The elements 



can be obtained from a local medium such as a CD, or a video tape. Alternately, the 
elements can be obtained from a remote location via wired or wireless transmission. 
Elements can include audio works such as music or audio/visual works including 
advertisements, music videos or other types of elements. 
5 The elements can be stored on a readable digital storage medium. Some 

or all of the elements can be played back or performed individually. 

A collection of separate elements can be identified and arranged. One 
form of arrangement is a list. Another is a non-linear tree-like arrangement. 

The collection can be played back or performed sequentially as 
1 0 specified in a list. Alternately, the elements can be performed interactively as specified 

in a tree. In this embodiment, tree nodes represent decision points for a viewer or a 
listener. 

A graphically-oriented editor is provided for building or editing lists or 
trees. The lists or trees can be stored and subsequently retrieved for editing or 

1 5 performing the collected media elements. 

Output can, in one aspect, be an audible or a visible performance of the 
elements in accordance with a selected list or tree. In another aspect, the collection can 
be written to a medium. Hence, a CD or other digital medium can be written, or audio 
or video tapes can be recorded. The output medium is not a limitation of the invention. 

20 In yet another aspect, a system incorporating a card reader or a vending 

unit can be used to build a list of elements. In this instance an appropriate credit needs 
to be established before an element can be added to an on-going collection being 
performed. 

Subsequent to a credit being established and a selection or selections 
25 made in accordance with the credit, elements can be added to the list and performed. 

Elements can be exclusively audio. Alternately, elements can include both audio and 
video components without limitation. 
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In yet another aspect, the method includes building a list of media 
elements which can come from a variety of sources. Preferably, the media elements 
are storable in a digital format. 

Subsequently, the list can be reviewed visually by a user and either 
5 modified or edited for the purpose of creating a sequence of media elements to be 

replayed or presented. Subsequently, the list is executed and the elements are either 
presented audibly or visually or both in accordance with their characteristics. 

In a further aspect, a digitized inventory of media elements can be 
created by either reading a local digital medium, such as a CD ROM or by receiving, 
1 0 via wireless transmission, digitized sequence of works which can then be stored in the 
inventory. If desired, the user can preview some or all of any element in the inventory. 

Numerous other advantages and features of the present invention will 
become readily apparent from the following detailed description of the invention and 
the embodiments thereof, from the claims and from the accompanying drawings. 
15 Brief Description of the Drawings ; 

Figure 1 is an overall flow diagram of a method in accordance with the 
present invention; 

Figure 2 is a block diagram of a system useable for practicing the 
method of Figure 1; 

20 Figures 3A through 3P taken together illustrate a flow diagram of a 

control program useable with the system of Figure 2; 

Figures 4A through 4K illustrate various screens presentable by the 
control program illustrated in Figs. 3 A through 3P; 

Figure 5 is a block diagram of a system intended to receive audio or 
25 visual works from a remote source; 

Figure 6 is a diagram of a system intended to provide a custom written 
medium of works obtained from a remote source and in response to establishing a pre- 
determined credit; and 
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Figure 7 is a diagram illustrating a system for presenting works on 
demand from either a local or a remote source. 
Detailed Description of the Preferred Embodiments ; 

While this invention is susceptible of embodiment in many different 
5 forms, there are shown in the drawing and will be described herein in detail specific 

embodiments thereof with the understanding that the present disclosure is to be 
considered as an exemplification of the principles of the invention and is not intended 
to limit the invention to the specific embodiments illustrated. 

Systems and methods which embody the present invention enable the 
10 user to acquire, for example, digitized audio or audio and video works, which are of 
interest and which are to be represented either in real time as an audio or an 
audio/visual work or to be written onto a digital storage medium as part of a sequence 
selected by the user. Functional capability is provided enabling the user to create one 
or more composite play or presentation lists which incorporate a plurality of titles or 
1 5 designations of the works in a user selected order. The works could come from a 

variety of different sources and could include other types of sensory outputs without 
limitation. 

As part of the list preparation process, the user can listen to or view 
some or all ofany of the works. A new list can be graphically created. An existing list 
20 can be edited to revise existing works identified in the list, change the order of 

presentation or to add new ones. Subsequently, the list can be executed and the works 
performed. 

Execution of the list will present the works in the determined sequential 
order audibly or visually and audibly depending on the nature of the work. Alternately, 
25 the works represented on the list can be written to a digital storage medium, such as a 

CD or DVD for subsequent presentation. 

Figure 1 illustrates steps of a method 10 for preparing executable 
playlists in accordance with one aspect of the invention. In an initial step, selected 
audio or video elements can be loaded into a digital database, a media inventory, for 
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review and subsequent presentation. Media elements can be obtained from locally 
played sources or by wireless signals received from a remote source, such as via an 
antenna, which are demodulated and stored in digital form in the media inventory. 

In the next step, a plurality of playlists can be created by graphically 
5 selecting media elements to be entered into a selected list from the inventory. As part 

of the step, one or more playlist records can be built and stored. 

In a subsequent step, the lists in the playlist database can be viewed and 
various reports concerning the subject Ust can be created. 

In a subsequent step, one or more of the lists can be graphically edited 
10 thereupon rearranging items in a list, adding items or deleting items as desired. 

Finally, a particular list can be selected and executed. Audio works are 
presented sequentially, in accordance with the selected list, via audio output 
transducers, typically speakers. Video works or audio/video works or presented in 
accordance with the selected list on a video display in combination with speakers. 
1 5 If desired, a selected list or lists can be written to a storage medium such 

as a CD ROM for later use. If desired, the associated media elements can also be 
v^itten on to the medium. 

A variety of services can be provided to a user while carrying out the 
steps of the method 10, Analysis can be conducted of the characteristics of various 
20 works. For example, beats per minute can be determined and audio works can be 

sorted accordingly. A list or lists can be created in accordance with a pre-selected 
tempo or beats per minute. 

Sorting or selecting based on other features of audio or video 
characteristics of the works can also be included. Presentations via a selected list can 
25 be controlled based on selected features. 

For record keeping purposes, the number of times a given media 
element is presented or executed can be logged along with date and time information. 
Reports reflecting any lists created based on any of the above selection features or 
characteristics can also be printed for invoicing, billing or royalty payment purposes. 
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Figure 2 illustrates in block diagram form a system 10' for 
implementing the method 10 of Fig. 1. The system 10' incorporates a programmable 
processor 12a, for example, a personal computer of a selected variety. Coupled to the 
processor 12a is a mass digital storage medium 12b, such as a hard disk drive for 
5 storage of various databases and programs. 

Coupled to the processor 12a is a source of digitized audio or 
audio/visual input signals such as a CD ROM drive 1 2c, Media elements or works can 
also be received wirelessly. Also coupled to the processor 12a are user input devices 
such as a mouse 12d and a keyboard 12e. Other input devices could also be used 
1 0 without limitation. 

Output devices include a display screen 12f of a type conventionally 
used with programmable processors to present visual display of ongoing programs 
being executed to the user. A printer 12g is available to provide reports. 

Audio and video output devices for media elements include speakers 
15 1 4a and video output device 1 4b which can be of a size and quality suitable for the type 

of works being displayed. Other output devices could also be used. 

The hardware components of the system 1 0 ' interact in accordance with 
the user inputs and under the control of a control program 16 stored in one of the 
storage devices 12b. The control program 16 includes pre-created commands for 
20 carrying out the method 10 illustrated in Fig. 1 , 

The control program 1 6 is described in a set of flow diagrams illustrated 
in Figs. 3 A...3M. Figs. 4A-4K illustrate various exemplary displays presented on the 
display unit 12f while the control program 16 is executing. 

Fig. 3 A illustrates the initial steps in reading a source of digitized 
25 works, such as a CD and in selecting either the record sequence. Fig. 3B, 3C, and 3D, 

the list player sequence Fig. 3H and 31, or the playlist editor sequence Figs. 3E, 3F and 
3G. In step 1 00 a determination is made if a CD is present in the drive 12c. If so, the 
program 16 initiates record steps illustrated in Figs. 3B, 3C and 3D. If not, the playlist 
master database is checked in a step 101. If playlists had previously been created, the 
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playlist screen sequence is executed, Fig. 3H and 31 in step 102, Alternately the editor 
sequence can be entered, Figs. 3E, 3F and 3G in step 103. 

With respect to the record sequence Fig. 3B, during the process of 
recording information off of the respective CD, in a step 1 1 0 an initial screen, Fig. 4 A 
5 is displayed. If the processor 12a determines in a step 112 that a CD is not present, 

then a CD missing display, Fig. 4B is presented in a step 113. 

In the event that a CD is present, in a step 114, information will be read 
off of it as to track numbers and play times and displayed in a step 1 16 as in Fig. 4C. 
In a step 118, the master CD database is checked and if a corresponding record is 
10 found, in a step 120 the name of the CD is displayed, as indicated in Fig. 4C. Where 

tracks off of the respective CD had been previously recorded, in step 122, that 
information will be retrieved from the track database and displayed also as illustrated 
in Fig. 4C. The length of each track, recording date, title artist and type of work all can 
be displayed. 

15 With respect to Fig. 3C and 3D, in a step 124 the control program 16 

determines whether or not the user has selected a track to play. If so, the selected track 
is played in a step 126. If desired, as illustrated in a step 126a characteristics of the 
work such as beats per minute can be computed and displayed for the user. 

In a step 128, the control program 16 checks to determine whether or 

20 not the user requested restart of a work at a specified point. If not the system 

determines in a step 130 if the user has selected one or more tracks to be recorded. If 
so, in a step 132, selected tracks are recorded. 

The system control program 1 6 also determines whether or not the user 
has requested a deletion in a step 134 or requested that a new CD be loaded in a step 

25 136, select options in a step 138, a tables function in a step 140 or an exit function in 

a step 142. In each of steps 136, 138, 140 and 142, the requested respective procedure 
is carried out. 

Where a user has selected the edit screen, illustrated in Figs. 3E, 3F and 
3G, one or more pre-existing play lists can be retrieved and edited. In a step 150, a 
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playlist selection menu is displayable by the control program 16, in accordance with 
Fig. 4F. Using the selection menu a particular playlist can be selected and the detail 
retrieved in a step 1 52 for the selected playlist. The selected playlist can be displayed 
for editing as illustrated in Fig. 4G in a step 1 54. For the convenience of the user, the 
5 editor screen. Fig. 4G, illustrates in an upper section, an inventory list of available 

works currently in inventory which can be selected and entered into the destination 
playlist, in the lower portion of the display illustrated on Fig. 4G. 

As illustrated in Fig, 3F, in a step 160, a user can edit or revise 
selections or the sequence of selections in the subject list using an editor selection 

10 screen as illustrated in Fig. 4H. In the event that the user requested a change in the 

play sequence in a step 162, an update procedure is executed in a step 164 
corresponding to Figs. 3D and Fig. 41. It will be understood that standard editing-type 
functions will be available to the user as would be known to those of skill in the art. 

In a step 166 the user can request that a particular selected work be 

1 5 played or presented. The works can be restarted in a step 1 68 at a particular point. 

The user can insert a work or a song in playlist in a step 170. With 
respect to Fig. 3G, a work or song can be moved within the playlist in a step 172. A 
particular song or work can be removed from the selected playlist in a step 174. The 
entire playlist can be deleted in a step 176. 

20 In the event that the user desires to select a particular playlist for 

execution, in a step 1 02, Fig. 3 A, the playlist master database is read in a step 200, Fig. 
3H. The playlist player selection menu Fig. 4J is displayed in a step 202. If the user 
selects a playlist in a step 204, the playlist detail is read from the appropriate database 
in a step 206. The selected playlist is then displayed, Fig. 4K, in a step 208. 

25 With respect to Fig. 31, the user can exit the player screen sequence or 

can request execution of the playUst in a step 210 at the beginning of the list or at a 
specified work or song. The list is then executed in a step 212. 

In the event that one or more reports are to be created using the printer 
12g, the process of Fig. 3 J can be used to request reports as to existing playlists in a 
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step 230. Alternately, the user can request a report of the existing inventory of media 
elements in a step 232. 

Screen selection is carried out in accordance with the process illustrated 
in Fig. 3K. Updating of data from the record screen is carried out in a process 
5 illustrated in Fig. 3L. 

Fig. 3M illustrates steps associated with carrying out requests for 
various optional functions. For example, in a step 240 an option screen. Fig, 4D, can 
be displayed for a user. 

The user can subsequently in a step 242 change the record options. In 
10 the event that the user in a step 244 selects a record directory, the record directory 
screen Fig. 4E can be displayed in a step 246, The displayed screen can be altered by 
the user in a step 248. The revised record options can be stored in a step 250 for 
subsequent use. 

Fig. 3N illustrates steps of a process wherein the user is able to select 
1 5 and display various tables. In a step 260 an artist table can be displayed and edited in 

a step 262. In a step 266 the type table can be displayed and edited in a step 268. In 
a step 270, the CD table can be displayed and edited in a step 272. The track table can 
be displayed in a step 276 and edited in a step 278. 

Fig. 30 illustrates the steps in a process of saving the play list screen, 
20 Fig. 41. In a step 290 the playlist save screen is displayed. In a step 292, if the user has 

selected to save the existing playlist, the changes are written to the respective database 
in a step 294. If the user elected to save the new playlist in a step 296, the changes are 
written to the new playlist database in a step 298. Finally, the user can discard the 
changes and exit in a step 300. 
25 Fig. 3P illustrates the steps of a procedure for deleting a selected work 

or track. 

Hence, as described above, the system 10' can be used to create new or 
modified playlists, and execute same thereby presenting the sequence of works to a 
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user. Alternately, pre-existing playlists can be edited and additional new playlists 
created which then subsequently be executed. 

Those of skill in the art will understand that other functions as 
illustrated in Figs. 3A-3P will also be provided by the control program 16. Attached 
5 hereto is a preferred data structure for use with the flow diagrams of Figs. 3A-3P. 

Figs. 5 through 7 illustrate alternate types of list building systems. Fig. 
5 illustrates a system 10-1 which is a network based play list creating and executing 
system. The system 10-1 incorporates a remote source 20 of works which are to be 
assembled and played or presented at a user's imit or terminal 22. The unit 20 is 

1 0 intended to be an element or a location accessible via a network. For example, the unit 

20 can be a location on an internet or the internet or any other network. It can be 
accessed via a land line or wireless communication link 24 without limitation. 

The system 20 incorporates a processor 20a, and databases 20b. The 
databases 20b include stored digital representations of a variety of works which can be 

15 obtained off of local drives, such as the drive 20c without limitation. The remote 

system operator has available standard input control devices such as mouse 20d, 
keyboard 20e or other desired input devices. A display screen 20f of the conventional 
variety is also provided. The remote system 20 also includes an optional printer 20g 
for purposes of creating hard copy reports for invoicing, billing or royalty payment 

20 purposes without limitation. 

The system 20 provides a remote pre-stored inventory which the unit 
22 can access via communication link 24. The unit 20 provides supervisory and billing 
services in response to requests by the end user's xmit 22 for access to one or more of 
the works stored in the inventory in the databases 20b. 

25 Subsequent to the request being authorized, the selected works can be 

made available to the terminal 22 via the communication link 24. The unit 22 can in 
turn be used as described previously to create new playlists, edit existing lists and then 
execute the lists under the control of the local end user. The terminal 22 is especially 
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convenient for the end user in that the works all be acquired electronically and 
there is absolutely no need for acquiring and keeping a plurality of CDs. 

If desired, processor 12a in system 10-1 can keep track of the number 
of plays and total play time and transmit that information to processor lOa,, for billing 
5 purposes. Reports producible by the processor 20a include total plays and play time 

along with invoices for end users. Documentation for royalty payments to the 
appropriate recipients can also be created. Finally, the reports can list those works by 
demand or popularity by day, week or month. 

Figure 6 illustrates a system 1 0-2 which includes a remote source, such 
10 as the remote source 20 and a local terminal 22-1. Terminal 22-1 includes elements 
similar to the terminal 22 previously discussed. Corresponding elements are identified 
with the same identification numeral. 

The terminal 22-1 additionally includes a credit establishing input such 
as a credit card reader 30. The reader 30 can be used by a user to make a credit card 
1 5 account number available to the terminal 22-1 for biUing purposes. 

Once a credit line has been established, the user will be able to use the 
terminal 22-1 to create and/or modify one or more playlists into write the selected 
media elements via an output drive 32 to aremovable mediimi 34 which could be a CD 
or a DVD. 

20 The terminal 10-2 could be located in a business establishment and 

users interested in obtaining a custom combination of works can access the services of 
the terminal 22-1 via the reader 30 for purposes of creating and writing the desired 
sequence of works on the medium 34. Other services made available by the terminal 
22 can also be made available by the terminal 22-1 in response to the established credit 

25 line. 

Additional services that can be made available by the terminal 22-1 
include printing invoices via the printer 12g. Report information can be transmitted 
to the system 20 for billing purposes with respect to the commercial establishment 



11 



where the terminal 22-1 is located as well as making royalty payments to appropriate 
recipients. 

Fig. 7 illustrates an alternate system 10-3 which can be used for 
entertainment purposes in public establishments. The system 10-3 provides jukebox- 

5 like services at the terminal 22-2. These are under the supervision and control of 

remote system 20, 

The terminal 22-2 includes a credit establishing device which could be 
a coin or a bill receiving \mit 40 of a type used with vending machines. Alternately, 
the unit 40 could also accept credit cards if desired. 

1 0 Upon establishing an appropriate credit via the unit 40, the terminal 22- 

2 enables a user to select one or more works whose titles might be displayed on the 
control screen 12f viathe input devices 12d, 12e. 

The selected works could be resident at the local database 12b or could 
be acquired from the remote unit 20 via the conraiimication link as discussed 

15 previously. The system 22-2, unlike conventional jukeboxes, has an unlimited 

selection of audio or audio/video works available to it via communication link 24. In 
addition, for security purposes, the terminal 22-2 does not include an inventory of 
valuable CD or DVD media. The works coidd include audio works, such as music, 
audio/visual works such as advertisements, music videos or others. 

20 The terminal 22-2 presents a rolling playlist on the screen 1 2f which can 

be reviewed by the end user or individual selecting the works to be presented. Newly 
selected or identified works are added at the end of the playlist and are presented via 
speakers 12a and video output 12b in sequence depending on the nature of the work. 
Hence, the terminal 22-2 makes possible the presentation of arbitrarily selected works, 

25 in an arbitrary order in response to the credit established by the unit 40. 

The remote system 20 via the link 24 monitors the works being 
presented and the frequency thereof. Billing information can be generated for purposes 
of charging the entity where the terminal 22-2 is located for each work which is 
presented. Reports can be produced at the system 20 identifying royalties to be paid 
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to the appropriate recipients based on the works selected for presentation at the 
terminal 22-2 or for any other desired purpose. It will be understood that the 
appropriate file type would be used with the appropriate type of work. 

From the foregoing, it will be observed that numerous variations and 
modifications may be effected without departing from the spirit and scope of the 
invention. It is to be understood that no limitation with respect to the specific 
apparatus illustrated herein is intended or should be inferred. It is, of course, intended 
to cover by the appended claims all such modifications as fall vnthin the scope of the 
claims. 
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DATA STRUCTURE 

Table Field Name Data Type 

Master CD CD Number Long Integer Created by the track times 

CD Title Text 50 

Track CD Nimiber Long Integer 

Track Byte 

Artist Code Integer 

Type Code Long Integer 

Track Title Text 50 

Track Time Long Integer 

File Name Text 255 



Link to Master CD table 
Track number found on the CD 
Link to the Artist table 
Link to the Type table 

Actual time recorded in seconds 
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Beats Integer 

Playlist Master Number Coimter 

Title Text 50 

Playlist Detail Number Integer 

Play Order Integer 

CD Number 

Track Bjrte 

Artist Artist Code Counter 

Artist Name Text 255 

Type Type Code Counter 

Music Type Text 50 



Path/File Name of stored WAV 
file 

Beats per minute 
Database assigned key 

Link to Playlist table 

Order the track was placed within 
the playbook 



Long Integer Link to Track table 



Link to Track table 

Database assigned Artist index 



Program assigned index to Music 
Type 



14 



